[nltk_data] Downloading package stopwords to /root/nltk_data...
[nltk_data]   Package stopwords is already up-to-date!

Rewards Analytics and Distribution Dashboard for Quantification Review¶

This document processes the outputs of the praise reward system and performs an analysis of the resulting token reward distribution.

Out[6]:

Distribution report for round-35

  • This period covers praise given between 2023-11-01 and 2023-11-13.
  • We allocated a total of 26370.666666666668 TEC tokens for rewards.
  • Duplicate praise received a weighting of 0.1 the value of the original praise.
  • We assigned 3 quantifiers per praise instance.
  • Praise receiver names were not hidden behind pseudonyms during quantification

Praise Data Visualization¶

Rating distribution¶

Since praise gets valued on a scale, we can take a look at how often each value of the scale gets assigned by quantifiers. Note: This metric disregards scores of praise marked as a duplicate, since the score of the original is already being taken into account.

Top 10 highest rated contributions¶

The ten highest rated contributions for this round were the following:

Out[9]:
Avg. score To Reason
69.0 griffgreen#0 for all the ENS outreach and pushing. without you, we would be missing 5 ETH in our pockets and I prefer ETH heavy pockets. Thanks for the amazing fundraising efforts
66.3333333333333 griffgreen#0 for quickly sending advance payment to our contributor who really needs it as financial support when travelling to Istanbul. We greatly appreciate all the effort and creative ways you're doing to make sure our contributors don't have any blockers to joing the Giveth Magic retreat and Devconnect! 🙌🏼
66.3333333333333 griffgreen#0 for explaining Gurves. You are so great at breaking down very complicated things in a very simple digestible language. You are great at teaching. :)
66.3333333333333 griffgreen#0 Becasue I understand from a bussiness perspective (even when we are "not" one), the tremendous monetary effort he has to make in order for this rereat to happen. Economic resources must have been changed from different areas for this to be possible without breaking (maybe just cracking a bit)
63.6666666666667 missgene#0 for all their work coordinating folks for Instanbul, ensuring that all forms are filled out and the people are all situated, prepped & ready to bond!
62.0 karmaticacid#0 For all her effort in not only keeping Giveth a float but going further and having on her mind ways to improve and make this a total success, weather is ENS, Epoch, QF rounds, etc! I love having a perspective of a bussiness mind in the team because I believe we need that, and I totally align to it. Aaaand for comming to the retreat when feeling like sh!!! Thank you for making the effort to share with us!
59.3333333333333 karmaticacid#0 for updating our grant for gg19, and applying for the round, relaying message points to comms and organizing issues for marketing out grant. It was a lot of work to manage while being present in the 1st day of our givconnect retrea
59.3333333333333 griffgreen#0 for helping me a lot with my "how to fundraise for nonprofits in crypto" talk for How 2 DAO. 1st draft of the prezo is done, and now at least I can get ONE good night's sleep for a day of cleaning it up & practicing tomorrow 🙏
57.6666666666667 missgene#0 for hunting down a restaurant in the vicinity that fit both our budget and our group size, coordinating the transport with the hotel, and getting everyone on the bus!
57.6666666666667 karmaticacid#0 For their great speech in how dao event, you guys are really amazing and inspiring

Praise Reward Distribution¶

We can now take a look at the distribution of the received praise rewards. You can toggle the inclusion of the different sources by clicking on the legend.

Praise Giving Distribution¶

We can also take a look at the amount of praise different users gave.

Praise Flows¶

Now for something more fun: let's surface the top "praise flows" from the data. Thanks to @inventandchill for this awesome visualization! On one side we have the top 15 praise givers separately, on the other the top 25 receivers. The people outside the selection get aggregated into the "REST FROM" and "REST TO" categories.

Out[13]:

Quantifier Data¶

Now let's take a closer look at the quantification process and the quantifiers:

Praise Outliers¶

To aid the revision process, we highlight disagreements between quantifiers.

Outliers sort by spreads¶

This graphic visualizes controversial praise ratings by sorting them by the "spread" between the highest and lowest received score.

Please keep in mind that this is a visual aid. If there are several praise instances with similar spread and quant score, all but one end up "hidden" on the chart. For an exhaustive list, take a look at the exported file "praise_outliers.csv" .

Praise score by quantifier -- outliers among the quantifiers?¶

Let's see how different quantifiers behaved by showing the range of praise scores they gave.

To interpret the box plot:

  • Bottom horizontal line of box plot is minimum value

  • First horizontal line of rectangle shape of box plot is First quartile or 25%

  • Second horizontal line of rectangle shape of box plot is Second quartile or 50% or median.

  • Third horizontal line of rectangle shape of box plot is third quartile or 75%

  • Top horizontal line of rectangle shape of box plot is maximum value.

Score displacement: tendency to under/over-scoring?¶

Scoring correlation: how similiar am I scoring with others?¶

Agreement on duplication¶

Out[22]:

Among 341 praises, 48 (14.08%) do not agree on duplication

Praise instances with disagreements in duplication are collected in 'results/duplication_examination.csv'. To compare, look at the last 4 columns: 'DUPLICATE MSG 1/2/3' and 'ORIGINAL MSG'.

Agreement on dismissal¶

Out[25]:

Among 341 praises, 1 (0.29%) do not agree on dismissal

Praise instances with disagreements in dismissal are collected in'results/dismissal_disaggreed.csv'. You can further look into who dismissed and who did not.